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ABSTRACT 

This paper introduces new technique for efficient calcula- 
tion of different Shannon information measures which oper- 
ates Binary Decision Diagrams (BDDs). We offer an algo- 
rithm of BDD reordering which demonstrates the improve- 
ment of the obtaining outcomes over the existing reorder- 
ing approaches. The technique and the reordering algorithm 
have been implemented, and the results on circuits' bench- 
marks are analyzed. We point out that the results are quite 
promising, the algorithm is very fast, and it is easy to imple- 
ment. Finally, we show that our approach to BDD reorder- 
ing can yield to reduction in the power dissipation for the 
circuits derived from BDDs. 



1. INTRODUCTION 

Over the years, many important problems in digital cir- 
cuits synthesis and optimization have been approached us- 
ing concepts from Information Theory. In the different 
fields of Computer Aided Design (CAD) of digital circuits, 
one is often faced with the task of computing information 
measures, especially Shannon entropy, of each of the sig- 
nal leads in the network. It is quite natural and valuable 
to consider switching activity in the terms of entropy mea- 
sures and to use entropy as a complexity characteristic of 
optimization process [^. For instance, the dominant part 
of power dissipation in integrated circuits is the dynamic 
power dissipation which is directly proportional to the sig- 
nal switching activity. The problem of estimating switch- 
ing activity could be solved efficiently if fast procedures for 
probabilities calculation are available [|l]]. In our research, 
we use the approach to compute probabilities based on the 
idea that the digital circuit is considered as a network with 
the probabilities of signal occurrence assigned to internal 
connections and outputs . 

The objective of this paper is to develop novel BDD 
based technique for calculation of different information 
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measures for further application in CAD problems. Addi- 
tionally, we present an algorithm of BDD reordering which 
can be applied for the synthesis of low-power circuits de- 
rived from BDDs. Among many emerging approaches, dig- 
ital circuits derived from BDDs are of great interest to en- 
gineers and scientists as they compound the junction for 
the class of low-power dissipation and highly testable cir- 
cuits. Concepts and techniques developed for circuits de- 
rived from BDDs can therefore be extended to other classes 
of digital circuits. On the whole, results obtained in the 
study of appliance of information theory may offer useful 
clues as how to tackle optimization problems concerning 
the design of digital circuits. 

The paper is structured as follows. In Section ^ we 
briefly review the basic notations of BDDs and information 
theory. Section ^ introduces a new technique to calculate 
information measures taking into consideration the assign- 
ment of probabilities on the graph representation. Then, we 
point out applications of this technique to BDD reordering 
and demonstrate case-study results in Section ^ Section ^ 
describes the conclusions. 

2. PRELIMINARIES AND ASSUMPTIONS 

Consider logic representation of a digital circuit in the form 
of Boolean function f treated as the mapping B" — > B™ 
over the variable set X = {xi, ■ ■ ■ ,a;„}, where B={0,1}. 
Here, n is the number of variables (inputs), and m is the 
number of functions (outputs). 

2.1. Graph-based Representation of Boolean Functions 

Binary Decision Diagrams (BDDs) have become the ad- 
vanced structures in CAD of integrated circuits for repre- 
sentation and manipulation of Boolean functions. 

BDD is a connected, directed acycUc graph, where: 

(i) each non-terminal node corresponds to Shannon expan- 
sion S of the function / with respect to variable x 
(incoming edge) into sub-functions (outgoing edges: 

edgei and edger): / = x • /u^o V x ■ Jw^i, 



(ii) a starting node is called root; a terminal node is la- 
beled with the leaf value and has no successors; a 
non-terminal node has exactly two successors. 

A BDD is called ordered if the variable x appears in the 
same order in each path from the root to a terminal node. 
The size of BDD (number of non-terminal nodes) may vary 
from linear to exponential depending on variables' order. A 
BDD is called reduced if it does not contain any nodes either 
with isomorthic sub-graphs or with both edges pointing to 
the same node. In our study, we always deal with reduced 
ordered BDDs (here, simply BDDs). 

2.2. Information Measures in Digital Circuits 

In order to quantify the content of information for a finite 
field of events A = {ai, 02, • • • , a„} with probabilities dis- 
tribution {p{ai)}, i = 1, 2, • • ■ , n. Shannon introduced the 
concept of entropy Entropy of the finite field A is given 
by 

n 

H{A)^-Y,p{ai)-\ogp{a,), (1) 

where log denotes the base 2 logarithm function. 

For two finite fields of events A and B with proba- 
bility distribution {p(ai)}, i — 1, 2, • • • , n, and {p{hj)}, 
j = 1, 2, • • ■ , TO, probability of the joint occurrence of 
and bj is joint probability p{ai, bj), and there is conditional 
probability, p(ai 1 6j) = p{ai,bj)/p{bj). The conditional 
entropy of A given B is defined by 

n m 

= -^^p(a„5,)-logp(a,16,). (2) 

i=i j=i 

In case of Boolean functions, we assume that the set of 
values of a function / and the set of values of arbitrary vari- 
able X are two finite fields [^. We calculate the probability 
P\f=b — k\f=b/k, where k\f=b is the number of assign- 
ments of values to variables (patterns) for which f = b and 
k is the total number of assignments. Other probabilities are 
calculated in the same way. 

Example 1. For the function f = 2:3 • X2 V xi with truth 
vector [10001111] according to Equations (^ and 1^: 
H{f) = -Vs • log2(V8) - Vs • log2(V8) = 0.96 bit, 

H{f\x^) = -Vs • log2(V4) - Vs • l0g2(V4) - Vs ' 

log2('*/4) — = 0.41 bit. By the same computations we 
have H{f\x2) = 0.91 bit, H{f\x3) = 0.91 bit. 

3. BDD BASED TECHNIQUE FOR CALCULATION 
OF INFORMATION MEASURES 

First and natural step of calculation of information measures 
is to determine the probabilities of a function and their sub- 
functions (see Equations ([I]) and (^). 




(a) (b) 



Figure 1 : Calculation of output probabilities using BDD 
3.1. Probability 

First attempt to compute the output probabilities was pro- 
posed in [|l|, where an exact strategy based on BDDs is 
described which is linear in the size of the correspond- 
ing function graph (the size of the graph, however, may 
be exponential in the number of circuit inputs). The fur- 
ther extension of such BDD traversal in a down-top fashion 
was the probability assignment algorithm presented in [^. 
In the case of completely specified Boolean function /: 
p{x = 0) = p{x = 1) = ^/2, and the output probability of 
the constant function "1" is 1 (p{leaf\f = 1) = 1) and the 
output probability of "0" is (p{leaf\f = 0) = 0). Since 
each node of BDD is an instance of Shannon expansion, for 
a node representing a function /: 

Pif) = V2 • Pi.f\.=o) + V2 • p(/|.=i)- (3) 

An alternative is to use top-down strategy. The algo- 
rithm of probability assignment presented in [||] can be 
rewritten in our notations as: (i) p{root) — 1 for the nodes 

of ;ewe; = 0; (ii) p*(node'™^'+i) = p* {edge^^"""^) + ...+ 
p*{edge^y'"'^^) for any node of the level which has exactly 
V incoming edges; (iii) p{f = 1) = p*{leaf\f = 1) and 
p{f = 0)=p*(leaf\f^O). 

Example 2. Let us consider two strategies for calcula- 
tion of output probabilities of the function f from Exam- 
ple 0. We run top-down like BDD traversal with assigning 
P*if = 1) = 1 and obtain p{f = 1) = P*{leaf\f — ^) — 
0.625, as indicated in Figure 0(fl). Down-top approach 
with assigning p{leaf\f = 1) = 1 gives us p(f = 1) = 
p{root) = 0.625, as shown in Figure^b). 

In our exploration, we utilize the modification of the 
first strategy where the actual output probability of the 
function / is assigned to the root node. We extend the 
approach to calculating the output probabilities (Equa- 
tion (^) to the following recursive algorithm: p{node) = 



V2 -piedgei) + V2 - pledger), where p{leaf\f = 1) = 1 
and p{leaf\f = 0) = 0. Thus, the output probabiHty be 
p{f = 1) =p{root) and p{f = 0) =1 — p{root). For gen- 
eralization the coming next recursive algorithm is proposed: 

p{node) = p(x = 0) • p{edgei) + p{x 1) • p{edger). 

This algorithm allows to calculate conditional and joint 
probabilities which are needed for computation of condi- 
tional entropy according to Equation (^. Thus, for joint 
probability p(/ = l,x = 1) it is needed to setp(a; = 1) = 1 
and p(x = 0) = before BDD traversal. Such approach al- 
lowed us to develop a technique for calculation of the whole 
range of probabilities using only one BDD traversal. 

Example 3. The results of setting p{x2 = 0) = 1 and 
p{x2 = 1) = 1 for the function f from Example^ give 
us conditional probabilities p{f = 11x2 = 0) = 0.75 and 
Pif = 1\X2 = 1) = 0.5. 

3.2. Shannon Information Measures 

In proposed an algorithm based on symbolic compu- 
tations for exactly determining the entropies of digital cir- 
cuits. It was reported that the technique is viable, as proved 
by the results obtained on a large set of mid-scale functions. 
This exact approach breaks down when applied to large ex- 
amples. 

Our technique for exact computation of Shannon infor- 
mation measures for Boolean functions represented in the 
form of BDDs exploits the following. Equation ([l|) is used 
for computing the entropy H{f) of the function / together 
with the described above algorithm for calculation of output 
probabilities. The conditional entropy H{f\x) of the func- 
tion / with respect to the variable x can be simplified using 
the theorem below: 

Theorem 1. The conditional entropy H{ f\x) can be calcu- 
lated by the following equation: 

H{f\x) = p{x = 0) • i/(/|,=o) + P{x - 1) • (/|.=i) 

It means that for calculation of conditional entropy we 
need to compute the entropy of each sub-function. In this 
case probability must be assigned to every node in BDD in 
order to distribute the desired output probability to the root. 

Example 4. The entropy of the function f from Example ^ 
be: H{f) — 0.96 hit. The conditional entropy of the func- 
tion f given X2 be: H{J\x2) = V2 • H{fi^ + V2 ■ 
H{f\a:^=i) = 0.41 + 0.5 = 0.91 bit (Figure |j. The same 
manipulation yields: H{f\xi) — 0.41 hit and H{f\x^) = 
0.91 bit. The conditional entropy of the function f given a 
set of variables {xi, X2} be: H{f \x1X2) = 0.25 bit. 




Figure 2: Computing information measures using BDD 

Input BDD for the given function / 
Output New order of the variables 
Jnfo"(/) 
{ 

for (ilevel : level — 1 . . .n ) { 

for{Wx of the level > level) { 

Calculate p{f = l\x = 0) and p{f — l\x = 1); 
Calculate H{f\xi) using Theorem hi; } 
Reorder variables according to 

Equation (g) : Hif\x,,)<...<H{f\xjJ; 
Rebuild BDD using xj-^^ for current level; } 

} 

Figure 3: The sketch of the algorithm /«/o^ 

4. BDD REORDERING ALGORITHM 

We have realized the described above idea of calculation of 
information measures to obtain the whole range of informa- 
tion measures using only one BDD traversal, and we uti- 
lize these measures for BDD reordering. New BDD order 
is built taking into consideration the information criterion. 
The criterion to choose a decomposition variable x for the 
arbitrary level of BDD is that the conditional entropy of the 
function / with respect to this variable has to be minimal: 

H{f\x)^miniHif\x,)\\^x^). (4) 

Figure Hgives a sketch of the algorithm for BDD reordering. 

4.1. Experiments 

We have implemented the technique for calculation of in- 
formation measures and BDD reordering algorithm within 
CUDD package [^. We have run experiments on several 
sets of benchmarks (combinational and sequential circuits) 
selected from the ISCAS85 and ISCAS89 suite on Pen- 
tium III 650Mhz with 64Mb of memory. 



In Table U we give the outline of the first set of exper- 
iments, where information measures have been calculated 
(entropy for the first output /o and conditional entropy with 
respect to the first xq and second xi inputs, all numbers in 
bits). In Table ^ we report the second set of investigations, 
where BDDs have been built for both combinational and se- 
quential circuits using different reordering approaches (win- 
dow, genetic, sifting and our Info^). We observe that for 
some benchmarks algorithm Info^ produces better results 
than other reordering methods. 





Information measures 


Test 


H{.fo) 


HiMxo) 




C1908 


1.00 


0.017 


1.00 


C3540 


0.337 


0.272 


0.272 


C432 


0.385 


0.378 


0.378 


C6288 


0.811 


0.50 


0.50 


C880 


0.544 


0.406 


0.406 


S1196 


0.896 


0.842 


0.883 


S1512 


0.954 


0.905 


0.749 


S344 


0.811 


0.50 


0.749 


S4863 


0.982 


0.922 


0.922 


S635 


0.811 


0.811 


0.50 



Table 1 : Some values of information measures 





Size [number of nodes] 


Test 


Window 


Genetic 


Sifting 


/n/o" 


CI 7 


11 


11 


11 


9 


CI 908 


36007 


36007 


36007 


65032 


C432 


1733 


1733 


1733 


2425 


C880 


346660 


346660 


21965 


319071 


SI 423 


98454 


98454 


98454 


73680 


S298 


125 


125 


125 


175 


S349 


206 


206 


206 


141 


S382 


168 


168 


168 


171 


S820 


2651 


2651 


2651 


2283 



Table 2: Different algorithms of BDDs reordering 



4.2. Low-power Design: Case Study 

For many consumer electronic applications, low average 
power dissipation is desirable, and for certain special ap- 
plications low power dissipation is of critical importance. 

Example 5. According to the criterion (Equation f^j and 
the values of conditional entropy (Example^), the order of 
variables in BDD for the function f will be < X1X2X3 >. 
The power dissipated by circuits derived from BDD^- 

'We use SIS Release 1.2., UC Berkeley, 1994, as an environment for 
modelling of power dissipation (function power.estimate). 



Variables' order 


P, liW 


K ^±^2^3 < ^1^3^2 > 
<a:2a^l^3 > Or <^ x ^ > 
< ^a''2^1 > or < X2X3X1 > 


31.87 
45.0 
37.60 



The power consumption for best case is 1.5 times smaller 
than for the worst case taking into account the same size of 
BDDs for both cases. 

5. CONCLUDING REMARKS 

The purpose of this paper was to investigate possibility to 
calculate different information measures using BDD. We 
have presented the BDD based technique for computing of 
information measures from a theoretical as well as practical 
perspective. We can indicate what this problem can be eas- 
ily solved when Boolean function is represented as BDD. 

We have proposed reordering algorithm based on infor- 
mation criterion which provides an improvement in BDD 
size for some benchmarks in contrast to existing reordering 
methods. The BDD reordering using information measures 
was shown to be interesting for further applying in differ- 
ent problems, especially in the area of low-power design 
of digital circuits derived from BDD. It is hoped that this 
paper will help to widen the understanding of practical ap- 
plications of information theoretical concepts. 
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